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Abstract: We address the question of optimization of the microalgal biomass long term produc- 
tivity in the framework of production in photobioreactors under the influence of day /night cycles. 
For that, we propose a simple bioreactor model accounting for light attenuation in the reactor 
due to biomass density and obtain the control law that optimizes productivity over a single day 
through the application of Pontryagin's maximum principle, with the dilution rate being the main 
control. An important constraint on the obtained solution is that the biomass in the reactor should 
be at the same level at the beginning and at the end of the day so that the same control can be 
applied everyday and optimizes some form of long term productivity. Several scenarios are possible 
depending on the microalgae's strain parameters and the maximal admissible value of the dilution 
rate: bang-bang or bang-singular-bang control or, if the growth rate of the algae is very strong in 
the presence of light, constant maximal dilution. A bifurcation diagram is presented to illustrate 
for which values of the parameters these different behaviors occur. Finally, a simple sub-optimal 
bang-bang strategy is proposed that numerically achieves productivity levels that almost match 
those of the optimal strategy. 
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Commande periodique optimale pour la majcimisation de la 
productivite de biomasse dans un photobioreacteur utilisant 

la lumiere naturelle 

Resume : Nous abordons la question de roptimisation de la productivite de biomasse mi- 

croalgale dans le cadre dc la production cn pliotobiorcactcurs sous I'lnflucncc du cycle jour/nuit. 
Pour cela, nous proposons un modele simple de bioreacteur qui tient compte de I'attcnuation lu- 
mineuse dans le reacteur liee a la densite elevee de biomasse et une loi de commando qui optimise 
la productivite sur unc seule journee par I'application du principe du maximum dc Pontryagin, 
avec la dilution comme commande principale. Une contrainte importante sur la solution obtenue 
est que la biomasse dans le reacteur doit etre au meme niveau au debut et a la fin du cycle 
de telle sortc q^ic Ic nicnic coutrolc pcut ctrc applique tous Ics jours ct optimise unc ccrtaine 
forme de la productivite a long terme. Plusieurs scenarios optimaux sont possibles en fonction 
des parametres de croissance de la micro-algues et de la valeur maximale admissible du taux de 
dilution: bang-bang, bang-singulicrc-bang ou. si le taux de croissance des algucs est trcs fort en 
presence de lumiere, dilution maximale constante. Un diagramme de bifurcation est presente 
pour illustrer pour quelles valeurs de parametres ces comportements differents se produisent. 
Enfin, une strategic sous-optimale bang-bang simple est proposee, qui permet d'approcher la 
productivite de la strategic optimale. 

Mots-cles : Commande optimale, commande periodique, photobioreacteur, productivite, bio- 
fuel 
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1 Introduction 

Microalgae have recently received more and more attention in the frameworks of CO2 fixation 
and renewable energy [TJ[2]. Their high actual photosynthetic yield compared to terrestrial plants 
(whose growth is limited by CO2 availability) leads to large potential algal biomass productions 
of several tens of tons per hectare and per year [2,. Also, they have a potential for numerous high 
added value commercial applications |3] as well as wastewater treatment capabilities including 
nutrients and heavy metal removal |31|S]. We focus on the industrial production of microalgae 
in the so called photobioreactors. In this work, photobioreactor is meant in the large, including 
many possibles types of culturing devices, including the most simple open raceways systems. 

Concentrating on the bioenergy applications of microalgae, one central feature is the energy 
balance of the process; the only conceivable light source {i.e the primary energy source) is natural 
sunlight, which varies during the day. This variation might have an important impact on the 
microalgae productivity; it is therefore necessary to take it into account in order to design control 
laws that will be applied to the bioreactor. 

The objective of this paper is to develop an optimal control law that would maximize the yield 
of a photobioreactor operating in continuous mode, while taking into account that the light source 
that will be used is the natural light. The light source is therefore periodic with a light phase 
(day) and a dark phase (night). In addition to this time- varying periodic light source, we will 
take the auto-shading in the photobioreactor into account: the pigment concentration (mainly 
chlorophyll) affects the light distribution and thus the biological activity within the reactor. As 
a consequence, for too high a biomass, light in the photobioreactor is strongly attenuated and 
per-capita growth is low. 

Optimal control of bioreactors has been studied for many years whether it was for metabolites 
production [6 , ethanol fermentation [7 , baker yeast production [S] or, more generally, optimal 
control of fed-batch processes taking kinetics uncertainties into account [2- The control of 
photobioreactors is however a lot more scarce in the literature, though the influence of self-shading 
on the optimal setpoint |IOj or on an MPC control algorithm [llj for productivity optimization 
has already been studied. The light-variation was mostly absent [lO) illj or considered to be an 
input that could be manipulated in order to impose the physiological state of the microalgae 
[TT or maximize productivity as one of the parameters of bioreactor design [T3] . The present 
problem has however not been tackled yet in the literature. 

We therefore developed a model that takes both the light variation and the self-shading 
features into account in order to develop the control law, where the substrate concentration in 
the input (marginally) and the dilution rate (mainly) will be used. This model should not be too 
complicated in order to be tractable and should present the main features of the process. Since 
we want to develop a control strategy that will be used on the long run, we could choose an 
infinite time-horizon measure of the yield. However, we rather take advantage of the observation 
that, in the absence of a discount rate in the cost functional, the control should be identical 
everyday and force the state of the system to be identical at the beginning of the day and 24 
hours later. We therefore opted for optimizing a cost over one day with the constraint that the 
initial and terminal states should be identical. 

The paper is structured as follows: in Section|2]we develop a photobioreactor model presenting 
all the aforementioned features; in Section[3]we identify the optimal operating mode in constant 
light environment; in Section[4]we develop our main result, that is the form of the optimal control 
law in a day & night setting; in Section [s] we identify the consequence if the control constraint is 
generous; we conclude by a simulation study and bifurcation analysis in Section |6] 
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2 A photobioreactor model with light attenuation 

Micro-algae growth in a photobioreactor is often modeled through one of two models, the Monod 
model p¥] or the Droop Model jT5]. The latter is more accurate as it separates the process of 
substrate uptake and growth of the microalgae. However, the former already gives a reasonable 
representation of reality by coupling growth and uptake, and is more convenient for building 
control laws since it is simpler. The Monod model writes: 

S = D{S,,,-S)-kpi{S,I)X , 

X = fi{S,I)X - DX , ^ ' 

where S and X are the substrate (e.g. nitrate concentration) and biomass (measured in carbon 
concentration, gC.L^^) in the medium, which is supposed to be homogeneous through constant 
stirring, while D is the dilution rate. Sin is the substrate input concentration and k is the 
substrate/biomass yield coefficient; fi{S, I) is the microalgae biomass growth rate, depending on 
substrate and light intensity /, which is often taken to be of the Michaelis-Menten form with 
respect to S and /: 

With Ks and Kj the associated half saturation constants. We will however not focus on this 
specific form and simply consider that n{S,I) — fis{S)fJ'i{T) is the product of a light related 
function and of a substrate related function iJ,g{S), such that /is(0) = 0, is increasing and 

bounded (with lim5_j.oo fJ-si^) — p-)- Generalization for the function will also be proposed 

later on. 

We will now provide extensions to this model so that it fits better to the production problem 
in high-density photobioreactors under study. 



2.1 Adding respiration 

The central role played by respiration in the computation and optimization of the productivity 
of a photobioreactor has been known for a long time (see e.g. [16"), since it tends to reduce the 
biomass. We therefore introduce respiration by the microalgae into our model. In contrast to 
photosynthesis, this phenomenon takes place with or without light: from a carbon point of view, 
it converts biomass into carbon dioxyde, so that we represent it as a —rX term that represents 
loss of biomass. The biomass dynamics then become 

X = fi{S)X -rX-DX . 



Remark that mortality is also included in the respiration term. Mortality can be high in photo- 
bioreactors, due to its high biomass density. 



2.2 Adding light attenuation 

When studying high concentration reactors, light cannot be considered to have the same intensity 
in any point of the reactor. We consider an horizontal planar photobioreactor (or raceway) with 
constant horizontal section A over the height of the reactor and vertical incoming light. We 
will then represent light attenuation following an exponential Beer-Lambert law |17j where the 
attenuation at some depth z comes from the total biomass Xz per surface unit contained in the 
layer of depth [0, z]: 

I{Xz) = /oe-''^- , (3) 
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where Iq is the incident Hght and a is a light attenuation coefficient, fn microalgae, chlorophyll 
is mostly the cause of this shadow effect and. in model ([IJ. it is best represented by a fixed 
portion of the biomass [18 , which yields the direct dependence in X in model ([s]). With such 
an hypothesis on the light intensity that reaches depth z, growth rates vary with depth: in the 
upper part of the reactor, higher light causes higher growth than in the bottom part. Supposing 
that light attenuation directly affects the growth rate [19], the growth rate in the form ^ for a 
given depth z can then be written as 

We see that this results in a differentiated biomass growth-rate in the reactor which could possibly 
yield spatial heterogeneity in the biomass concentration; however, constant stirring is supposed 
to keep the concentrations of S and X homogeneous. Then, we can compute the mean growth 
rate in the reactor: 

1 '■^ 



^^is,Io,x) = -J^ ^i,is,i{Xz))dz , 

where L is the depth of the reactor. It is this average growth rate that will be used in the lumped 
model that we develop. We then have: 

1 /oe""^^ 



1 . f lo + Ki 



2.3 Considering varying light 

In order to determine more precisely the model, we should now indicate what the varying light 
is like. Classically, it is considered that daylight varies as the square of a sinusoidal function so 
that 

2 



/o(t)- (^max|sin(^^^ ,o|^ 



where T is the length of the day. The introduction of such a varying light would however render 
the computations analytically untractable. Therefore, we approximate the light source by a step 
function: 

lo, <t <f — light phase , 
0, T <t<T — dark phase . 



In a model where the time-unit is the day, T will be equal 1. At the equinoxes, we have that 
T — , but this quantity obviously depends on the time of the year. 

2.4 Reduction and generalization of the model 

The system for which we want to build an optimal controller is therefore 



X = — ln('-^4'^*^^,^^)M5(^)^-rX-i?X 
aXL \Io{t)c-<^^^ + Ki '^''^ ' 



(4) 
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However, in order to maximize the productivity it is clear that the larger S the better: since it 
translates into larger growth rates of the biomass X. Hence, the control of the inflow concentra- 
tion of the substrate Sin should always be kept very large so as to always keep the substrate in 
the region where ^is{S) ~ ft- We can then concentrate on the reduced model 

X^Ain /"(^) + ^^ rX-DX, 

aL Io{t)c-'^^L + Ki 

where the only remaining control is the dilution D and which then encompasses all the relevant 
dynamics for the control problem. As was seen in [TU], the relevant concentration in the pho- 
tobioreactor, with Beer-Lambert light attenuation, is not the volumic density X but rather the 
surfacic density x = XL: the evolution of this quantity is indeed independent of the reactor's 
depth: whether we consider a deep and very diluted reactor or a shallow high concentration 
reactor with identical surfacic density 

i = '^=L{^,lr. ,J^--4,^ -rX-Dx) 

fl Io{t)+Ki (5) 

= ^ In ^ , . — rx — Ux , 

a Io{t)e-'^=' + Ki 

which is indeed independent of the depth L. 

The reduced model ([5| can be rewritten by taking advantage of the special form of varying 
light source as follows 

f{x)~rx- Dx, 0_<t<f, 

-rx -Dx, T <t<T . ^ ' 



with 



I 



This model is quite simple except for the only nonlinear term which directly comes from the 
form of III and from the Beer-Lambert law ([3|. In order to generalize our approach to more 
light responses {e.g. for high density photobioreactor with possible high light inhibition , see 
[20 ) and to not restrict ourselves to the Beer-Lambert law, we notice that the function f(x) is 
zero in zero, increasing in 0, bounded and strictly concave in x. Such a choice of f{x) yields 
the following somewhat trivial property, that will prove important in the following, and that is 
linked to f{x) being concave, with /(O) — and /'(O) > 0: 

Property 1 With f : 5?+ M strictly concave and such that /(O) — and /'(O) > 0, we have 
that, for any x > 0: 

no) > ^ > fix) , 

X 

which also shows that liTaiidj-^^ao f [x) < 0. 
Moreover 

A (M 

dx \ X 



< 



Proof: We have f{x) = /(O) + /q" f{s)ds with /(O) = and /'(O) > f'{s) > f{x) for all < 
s < X due to the concavity, so that f{x) < /'(0)ds = f'{0)x and f{x) > f'{x)ds — f'{x)x. 

The decreasing of comes from the explicit computation (^"^^j = ^ '''^^'^7'^''^'^ which 
is negative thanks to the previous property. □ 
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The four properties that we impose on f{x) should be expected from the net-growth in a 
photobioreactor: no growth should take place in the absence of biomass, it should be increasing 
because additional biomass should lead to more growth (at least at low densities); it should be 
bounded because, when x is very large the bottom of the reactor is in the dark, so that adding 
new biomass simply increases the dark zone without allowing additional growth; and the per- 
capita growth-rate should be decreasing because additional biomass slightly degrades the 
environment for all because of the shadowing it forces. 

As a generalization of the model ([s]), we consider that, during the day of length T < T, the 
system is written as 

X = f{x) — rx ~ ux , (7) 

with /(O) 0,f'{x) > 0,f'{x) < 0, f{x) bounded, r > and x,u e and, during the night 
of length T - T, as 

X = —rx — ux . (8) 

In order to couple both these systems, we define h(t) as a step function whose value is 1 for t < T 
and for t >T that will allow to synthetize ([7])-([8]) in the form 

i = f(x)h{t) — rx — ux . (9) 

As we will see, the central property that will be exploited is the strict concavity of /(x); in the 
following, we will use the simpler term "concavity" to denote that property. 

Lastly, in practice u cannot take any value: it should be positive, but also upper-bounded 
since its value is determined by the maximum capacity of some pumps. In the following, we will 
consider that < u{t) < w at all times (with it > 0). 



3 Productivity optimization in constant light environment 

In a constant light environment (i.e. h{t) is constant), we will be able to exploit the system 
at a steady state. In that case, the dynamics are strictly imposed by Q and the constant u 
and corresponding equilibrium value x*{u) are chosen in such a way that the maximum of the 
biomass flow rate at the output of the reactor with the upper surface A is reached. This is 
defined as max„(uA)a;*(u) and constitutes this productivity analysis. 

Since ux — f{x) — rx at equilibrium, maximizing uAx amounts to maximizing f{x) — rx. 
f{x) being concave, this is equivalent to find the unique solution of 

fix) = r , 

when it exists. Noting that lim2;_j._|_oo /'(a;) < and that /'(.) (see Property [ij is a decreasing 
function of x because of the concavity of /, this last equality has a positive solution if /'(O) > r is 
satisfied. This condition is crucial since, without it, the only equilibrium of the system is a; = 0, 
independently of the choice of u. Under this assumption, the biomass density that corresponds 
to the maximization of the productivity in a constant light environment is 

= {n-\r) . (10) 

so that that f{x) — rx is increasing for x < x^, and decreasing for x > Xa, which will extensively 
use in the following. We then obtain 

. (11) 
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which is positive by definition of X(j. In that case, the optimal instantaneous surfacic productivity 

Taking into account the actuator constraint, if < u, it yields the optimal productivity. 
Indeed, since it satisfies 

^-^-r^u. 
X* [uj 

with decreasing because of Property [l] x* [u) is a decreasing function which is larger than 
Xa for u < Ua. The productivity ux*{u) — f{x*{u)) — rx*{u) is then an increasing function of u 
because f{x) — rx is decreasing as long as u < u'^ and the optimal productivity is obtained with 
u = u. 

For convenience, we will define two other equilibria beyond x^-'- the equilibria of ([7| for u = 
and u = u, that we will denote xP and a;" respectively. 

Note that the study of the present section is in line with our work in |10| , where we considered 
the productivity optimization in a constant light for a Droop model with light attenuation. In 
that study, the analysis was much complicated by the link between shading and nitrogen content 
of the algae, so that both Sin and D had to be taken into account. 

4 Productivity optimization in day /night environment 

In an environment with varying light, a non constant input must be considered. Here we consider 
the case where the photobioreactor is operated on the long term, with a daily biomass production 
from the reactor outlet. The problem that we thus consider is the maximization of the biomass 
production over a single day 

T 



max / {u{t)A)x{t)(lt , 
«(*) e [o,Q] Jo 

We are then looking for a periodic regime, where, the photobioreactor is operated identically 
each day. This means that the initial condition at the beginning of the day should equal the final 
condition at the end of the day. This then requires that we add the constraint 

x{T) = x{Q) . 

In actual applications, the length of the bright phase will change slightly from one day to the 
next. This will probably impose a slight change of biomass at the beginning of the next day 
but, in this preliminary study, we will consider that such a phenomenon has little effect on the 
qualitative form of the solutions. 

We therefore are faced with the following Optimal Control Problem: 



T 



max / u{t)x{t)dt 

u(t) G [0,^1] Jo 

with X — f(x)h{t) — rx — ux 
x{T) = x{G) , 



(12) 



4.1 Dealing with the T-periodicity 

In order to solve this problem, it is convenient to observe that x{T) = x{Q) = xq cannot be 
achieved for all values of xq even without requiring optimality. For that, we consider the best 
case scenario, that is the one where u = for all i, which yields the largest value of x{T) since 



Inria 



Biomass productivity maximization in a photobioreactor 



9 



no biomass is taken out of the system (this is also seen by comparing the system with u = to 
systems with any u = u{t)); the value of x{T) obtained in the closed photobioreactor must then 



be larger than xq for (12 1 to have a chance to have a solution that starts in that xq. In this 
section, we will give a condition that guarantees that the set of initial conditions xq that yield 
x(T) > a;o in a closed photobiotreactor is contained in an interval I = [OjXomaa:], inside which 



the initial condition in the solution of (12 1 will lie. 

The first observation that we can make is that, for xq > 5;° (the equilibrium of system (|7| 
with M = 0), we have x{T) < xq because x{t) is then decreasing all along the solution. The 
upper-bound xomax, if it exists, is therefore smaller than x^. 

In order to guarantee that the interval is non-empty (or equivalently that Xomax > 0) we will 
then concentrate on what happens for xq in a small neighborhood of 0. The ([t]) dynamics with 
u — can then be rewritten as 

x^if'{0)-r)x, 

so that x{T) = a;oe(/'(o)-'-)^ and x{T) = a;(T)e-'-('^-^) = a;oe(/'(o)-'-)^e-'-(^-5'). We then have 
x(T) > Xq for Xq Small if the exponential factor is larger than 1, that is if: 

Assumption 1 The growth function f{x) is C^, bounded, satisfies /(O) = 0, /'(O) > 0, f"{x) < 
for all a; > and 

/'(0)T > rT . (13) 

This condition is quite natural since it imposes that, when the population is small, that is when 
the per capita growth rate is the largest, growth during the daylight period exceeds the net 
effect of respiration that takes place We have shown that this condition is sufficient but it is also 
necessary for xomax > since Property [T] imposes that 

X ^ f{x)h(t) ~rx~ux< {f'{0)h{t) - r - u)x 

so that, for a given Xq, x{T) in a closed photobioreactor is always smaller with the nonlinear 
system than the value x^{T) obtained with its linear upper approximate. A necessary condition 
for x{T) > Xq is therefore a;'(T) > xq, which amount to Assumption [l| which is therefore 
necessary for xomax > 0. 

Further properties are summed-up in the following proposition 

Proposition 1 If Assumption^ is satisfied 

System ^ has a unique initial condition xq = Xq which is such that x{T) = xq if u{t) = 
for all times. It is the unique fixed point of 



XqC ' 2 



This value Xq is such that, with u{t) ~ at all times, x(T) > xq for all xq < Xq, and 



x{T) < Xq for all xq > Xq so that xq 



max 



— - Xn 



If 

f'{0)T>{r + u)T , (14) 
there is a unique Xq = x^rnin such that x(T) — Xq if u{t) — u for all times. Also Xq solution 



of (12) belongs to the interval [xQrnm,Xoraax\ 
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All this is obtained by analyzing the dependency 



/(O " < 



d^ = r 



where x{T) is seen as a function of x^. 



Finally, since a;o < in the solution of (12 1, x{t) < x'^ at all times. Indeed, in the bright 



phase, x{t) cannot go through x*^ since the choice of u that maximizes i is u = that simply 
imposes convergence in infinite time toward x'^; in the dark phase, i < which also prevents 
x{t) from going through x'^ . 



4.2 Maximum principle 



In this section, we will show that the solution of (12 1 can have one of three patterns. In order 
to solve problem (12 1, we will use Pontryagin's Maximum Principle (PMP, [5T]) in looking for a 
control law maximizing the Hamiltonian 

H{x, u, A, t) = A {f{x)h{t) — rx — ux) + ux , 

with the constraint 



(15) 



X = f{x)h{t) — rx — ux , 
A = \{-f'{x)h{t) +r + u) -u . 

In addition, we should add the constraint 

A(r) = A(0) . 

as shown in [22]. We see from the form of the Hamiltonian that 

f ^<'-^)- 

so that, when A > 1, we have m = 0, when A < 1, we have u = u, and when A = 1 over some 
time interval, intermediate singular control might be applied. 

Of paramount importance in the proofs will be the constancy of the Hamiltonian. Indeed, 
it is known that the Hamiltonian is constant along optimal solutions as long as the time does 
not intervene into the dynamics or the payoff. We then have that the Hamiltonian is constant 
in the interval [0,T) (with h{t) = 1) and in the interval (f ,T] (with h{t) = 0). The Hamiltonian 
presents a discontinuity at T. 

We can first give some general statements about where and when switches can occur 

Proposition 2 If Assumption [l] is satisfied then, in the solution of problem (12 1 

(i) No switch from u — to u — u can take place in the dark phase; 

(ii) Switches from u = to u = u in the bright phase take place with x < x^-', 

(iii) Switches from u ~ u to u ~ m the bright phase take place with x > x^- 
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Proof: All these results come from the analysis of A at the switching instant. Indeed, at a 
switching instant, we have A = 1 so that: 

X^X{-f{x)h{t)+r). (16) 

The form of ^ indicates that a switch from u = to u = u (resp. from u = u to u = 0) can 
only occur if A < (resp. A > 0) . 



In the dark phase, ( 16 ) becomes A = rA > 0; no switch from u ^ to u ^ u can therefore 
take place (this shows (i)). 

In the bright phase, A < at a switching instant if f'{x) > r, which is equivalent to having 
X < Xcf-. this is therefore a condition for a switch from u = to u = u (this shows (ii)). 

Conversely, in the bright phase, A > at a switching instant if f'{x) < r, which is equivalent 
to having x > x^', this is therefore a condition for a switch from u = u to u = (this shows (iii)). 

□ 



In the following, we will propose candidate solutions to the PMP by making various hypothe- 
ses on the value of A(0) = Aq. 

Theorem 1 If Assumption [l] is satisfied then three forms of solutions of problem ( 12 1 are pos- 
sible: 

• Bang-bang with u(0) = 0, a single switch to u{t) = u taking place strictly before T and a 
single switch back to u{t) = taking place strictly after T; 

• Bang-singular-bang with u(0) = 0, a switch to u{t) = u„ taking place first strictly before 
T, a single switch to u{t) — u also taking place strictly before T and a single switch back 
to u{t) = taking place strictly after T. 

• Constant control at u{t) — u 

In the first two cases, the switch back to u{t) = takes place with x strictly smaller than it was 
at the moment of switch to u{t) ~ u. 

The proof of this result is detailed in appendix and is obtained by considering all possble situ- 
ations that are in concordance with Proposition Q and eventually eliminating all possibilities 
but the three cases detailed in Theorem [T] 

4.3 Synthesis: the three possible optimal solutions 

Without needing an explicit form of f{x), we have been able to obtain the qualitative form of 
the optimal solution analytically. In the bang-bang case, it is made of four phases: 

Solution 1 Bang-bang 

1. Growth with a closed photobioreactor until a sufficient biomass level is reached {u = 0, 
i: > 0, A > 1, A < 0); 

2. Maximal harvesting of the photobioreactor with simultaneous growth (u = u, x not deter- 
mined, A < 1, A < 0); 

3. Maximal harvesting of the photobioreactor with no growth until a low level of biomass is 
reached {u — u, i < 0, A < 1, A > 0); 
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4. Passive photobioreactor: no harvesting, no growth, only respiration (it = 0, i < 0, A > 1, 
A > 0). 

The first two phases take place in the presence of light, the other two in the dark. In phase 3, 
harvesting of as much biomass produced in the light phase as possible is continued while not 
going below the level where the residual biomass left is sufficient to efficiently start again the 
next day. 

If the optimal solution contains a singular phase, the analytical approach has helped us to 
identify the qualitative form of the optimal productivity solution. It now contains five phases: 

Solution 2 Bang-singular-bang 

1. Growth with a closed photobioreactor until the Xa biomass level is reached (w = 0, x < x^-, 
i > 0, A > 1, A < 0); 

2. Maximal equilibrium productivity rate on the singular 0. A = 1, 
A = 0); 

3. Maximal harvesting of the photobioreactor with simultaneous growth (u = u, x < X(j, 
i < 0, A < 1, A < 0); 

4. Maximal harvesting of the photobioreactor with no growth until a low level of biomass is 
reached {u = u, x < x^,, i < 0, A < 1, A > 0); 

5. Passive photobioreactor: no harvesting, no growth, only respiration {u — Q, x < Xc, x < Q, 
A > 1, A > 0); 

For this form of solution, we see that maximal instantaneous productivity is achieved during 
the whole second phase, when the singular solution occurs (Figure 3B). This solution with a 
singular form then seems to be naturally the most efficient one. It can however not always be 
achieved for two reasons: 



if ( 18 1 is not satisfied, u„ > u, so that it is not an admissible control. The solution should 
then be bang-bang and the application oiu = u has the same role as u„ in the solution with 
a singular arc since u = u is then the optimal solution to the instantaneous productivity 
optimization problem (Figure 3C). 



• if growth is not sufficiently stronger than respiration (with (13 1 satisfied however), a bang- 
bang solution that stays below x^ is optimal, because there is not enough time for it to 
reach x^ (Figure 3A). 

The only remaining solution is the one with u constant at u and is characterized by 

Solution 3 u — u 

1. Maximal harvesting of the photobioreactor with simultaneous growth (u — u, x < x^r, 
i > 0, A < 1, A < 0); 

2. Maximal harvesting of the photobioreactor with no growth (u = u, x < x^, i < 0, X < 1, 
A>0); 



Since this solution relies on the satisfaction of condition ( 14 1 , it is clear that it could mainly 
occur if the actuator has been under-dimensioned and when the dark phase does not last too 
long. 
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5 Discussion 

5.1 Existence and uniqueness of the optimal solution 

Existence of an optimal solution is obvious since the achieved yield for solutions satisfying x{t) = 
x{0) is bounded between (obtained for xq = xomax and u = 0) and x'^uAT (not achievable but 
an upper-bound nonetheless because x{t) < and u{t) < m at all times). The productivity level 
therefore has a finite supremum, which translates into a maximum since the set of definition of 
the u{t) control laws bounded by [0,u\ is closed. The optimal control problem therefore has a 
solution. 

We have also carried out a tedious analysis of the impossibility of existence of two different 
solutions of the maximum principle by showing that, once one solution has been evidenced, 
variations of the switching times cannot produce a second solution of the PMP satisfying both 
periodicity conditions (on x and A) . Once we have found a solution of the PMP, it is therefore 
optimal. This uniqueness result is not crucial in the following discussions. Therefore, we do not 
detail them. 



5.2 Large but limited u 

Too small an upper-bound u for u{t) gives rise to two kinds of optimal solutions where the 
constraint on the control really limits the productivity. First, when u < Ua, there could exist 
optimal solutions that go through Xcr but cannot stay at this optimal level because the required 
control value is not admissible. Secondly, an optimal solution (denoted Solution 3) could require 
the actuator to always be open. In order to prevent the first case, it suffices to design the actuator 



and chemostat so that u > Ua] note however that this does not imply that the solution of (12 1 
goes through a singular phase: growth could very well be too slow for the solution to reach the Xa 
level during the interval [0, T]. In the second case, the constant control u{t) = u for all times also 
indicates that the actuator is not strong enough since the only way the dilution can be efficient 
enough is by being active during the whole dark phase; a solution where the dilution succeeds 
in harvesting the chemostat at the beginning of the night is certainly to be preferred since it 



prevents respiration from taking too big a role. Condition (14 1 should then not be satisfied so 



that no periodic solution with u — u exists. In this Section, we then should have that 

'fiifTHr)] /'(0)T \ 



u > max 



It is however convenient to remember from Remark 1 that '^1 pw/''?"^ < /'(0)i ^nd that we 



trivially have ^ < /'(O). We will therefore make the simpler hypothesis: 



{f')-Hr) 

T 

u>f'{0)-r. (17) 

Note first that this implies that, when applying u = u, x = f(x)~rx — ux < f'{0)x~rx — ux < 
so that x" — and the biomass is always decreasing when the maximal dilution is applied. 



When ( 17 1 is satisfied, only two forms of solutions of the PMP are possible: the bang-bang 
solution that never reaches the x^ level because the net biomass growth is too weak (respiration 
included) and the bang-singular-bang solution. 



5.3 Unconstrained dilution rate 

When considering that u can be unbounded, there is the possibility for S impulses to occur in 
the solution of the PMP. We will not give any further mathematical developments, but things 
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Parameter 


Value 


Units 




1.7 


day^^ 


a 


0.5 


m^/g[C] 


lo 


1500 


/imol quantam 


Ki 


20 


/imol quantam^^s 


r 


0.07 


day^^ 


T 


0.5 


day 


u 


2 


day^^ 



Table 1: Growth and bioreactor parameters for Isochrysis galhana 
readily seem clear. 

In the limit, bang-singular-bang solutions would have the following form: the chemostat would 
be closed in the dark phase and at the beginning of the light phase until X — X (J IS reached. The 
solution would stay on x = Xu until t = T is reached. Any earlier impulse would force the 
solution to have more bang phases than possible, as demonstrated in the proof of Theorem [T] 
At i = T, a Dirac impulse is applied to bring A to 1 so that u = is then applied during the 
whole dark phase. The reactor then has three modes: a batch mode when x is different from x^, 
a continuous mode, on the singular arc and an instantaneous harvest at the transition between 
the bright and dark phases. The harvest consists in instantaneously replacing the medium with 
biomass-free, but substrate-rich, medium, to bring the biomass concentration to the mandated 
level. 

The bang-bang solutions that stay below x„ here become pure batch solutions with instanta- 
neous harvest, the reactor being always closed except at t — T (where A is brought to 1 through 
an impulse). 

We see from this analysis that, depending on the chosen microalgae and chemostat design, 
the optimal productivity is either obtained in batch mode or through the introduction of some 
continuous mode between batch phases. 

6 Simulations 

6.1 Isochrysis galhana 

We will now show the forms of Solutions 1,2, and 3 in the {t,x) space. For that, we start 
with a dynamical model Q for the growth of Isochrysis galhana with the parameters taken 
as in [10]. With such parameters, the critical values x^, = 14.93 and u„ = 0.9066 are easily 
computed, and the optimal solution is represented by the blue curves in Figure [T] It presents the 
bang-singular-bang structure of Solution 2 with u = Q until time t = 0.282 followed hy u = Ua 
until t = 0.420, u = u until t — 0.584 followed by u = 0. The corresponding daily surfacic 
productivity is then 6.33g[C]/m^ for a total cumulated flow u{t) dr equal to 0.453, that is 
45% of the medium has been renewed during the 24 hours. We then considered the application 
of a constant control during the 24 hours and optimized the level of this control numerically. The 
optimum was achieved for u = 0.461, which yields a daily productivity equal to &.2Qg[C]/m? and 
a cumulated flow equal to 0, 461 also. Three things need to be noticed from this comparison: 
(i) both optimal solutions are quite different in Figure [l] though the x values stay in the same 
range; (ii) the productivity increase generated by the optimal solution is very weak (1.11%); 
(iii) the total flow required to attain both optimal solutions are very similar. In fact, the fact 
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Figure 1: Bang-singular-bang optimal solution (in blue) confronted with the most productive 
constant dilution rate scenario (in red) for the microalgae Isochrysis galbana and the parameters 
of Table [l] At the top is the evolution of the biomass and at the bottom that of the control. 
The black dash-dotted lines represent the values of x„ and respectively 



that the improvement of the productivity is small is not surprising: the necessity of shutting 
down the chemostat at night is linked to the respiration that would consume the biomass. In 
the present case, the respiration is weak so that, during one night, only 3.44% of the biomass is 
consumed. This phenomenon is here marginal so that the optimal control approach developed 
to limit it provides little gain and what really matters is the total flow that goes through the 
photobioreactor. 

A second case needs to be studied, that is the one that corresponds to the case where u is 
smaller than u^, so that the singular phase is not possible. This yields Solution 1, the bang-bang 
case, when we take u = 0.8. However, we expect that the productivity would not be degraded 
much since we should be able to do better than the aforementioned case with u = 0.461, which 
is an admissible solution for the present control problem, and which gives a productivity that is 
barely below the optimal one with u = 2. It is indeed the case since, with switching times at 
t = 0.222 and t = 0.790 a productivity of 6.30g[C]/m'^ is achieved with a total flow of 0.457 still 
similar to the one observed in both previous cases. 

If we now reduce u to 0.1, a significant performance degradation should be expected since 
there is an upper-bound on the total flow. In fact, we obtained numerically that the optimal 
control here yields a constant control at u — 0.1 and a productivity of 4.355[C]/m^ which is 
68.7% of the one obtained when u — 2. 
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Figure 2: Bang-bang optimal solution (in blue) confronted with the most productive constant 
dilution rate scenario (in red) for a high-respiration species (?' = 0.7) and u — 2 

6.2 Importance of the respiration 

In this section we explore the impact of a large value for parameter r, which can be due to 
increased respiration, or to a high mortality as often is the case in high density cultures (however, 
we will stick to the respiration terminology). If we now consider a species that has all the 
characteristics of Isochrysis galhana except that it has a very large r equal to 0.7day~^, we expect 
the optimal strategy to have a much bigger impact on the outcome. Indeed, this respiration 
has much more importance at night than in the previous case since it consumes 29.5% of the 
biomass, hence the importance of limiting the biomass level at night. We see in Figure [2] that 
the optimal solution is here bang-bang with a short opening window at the end of the day and 
at the beginning of the night to harvest the produced biomass {u = u for t € [0.479,0.527]). 
The optimal production is here 0.6075[C]/m^ for a total flow of 0.096, that is a very little daily 
medium renewal while the best constant control u = 0.095 yields 0.5195[C]/m^. We see here 
that the daily total flows are again almost equivalent but that the productivity is here improved 
by 17% through the bang-bang approach, which is far from being negligible, especially since it 
is made with almost an exact same hydraulic effort as the constant dilution strategy. Though 
the x{t) solutions in Figure |2]both look similar, the larger population at night with the constant 
control strategy explains why there is more respiration when the control is constant than when 
it is bang-bang, hence less productivity. 

6.3 Bifurcation analysis 

In this section, we study more quantitatively the outcome of sections |6.1| and |6.2[ We draw 
2D-bifurcation figures for the parameters r and u (the other parameters being fixed at the values 
of Table [Tl . We build a bifurcation diagram for these two parameters by identifying in which 
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Figure 3: Bifurcation diagram defining the four (r, '«)-parametric regions where the different 
patterns of optimal solutions are encountered: bang-singular-bang control (above the black line) , 
bang-bang control (between the black, red, and magenta lines, constant control (below the red 
line) and no optimal solution (on the right of the magenta line) 



regions the different optimal solution patterns appear; these regions are delimited by solid lines. 

We first see in Figure [s] that, when r > ^ '^^'^ , no solution is possible because condition ( 13 1 is 
not satisfied. Only the wash-out of the photobioreactor can occur, whatever the control strategy. 
In the region below the red curve, the optimal solution is a constant control u(f) = u during 
the whole day and night; this was expected for these small values of u since the photobioreactor 
produces a quantity of biomass during the day that cannot be taken out if the actuator is not 
always open. The region where the solution is bang-bang is split into two by the u = u„{r) curve 
(dashed-dotted blue line of Figure [3]): when u < u^ir), no singular phase is possible and when 
u > Ua{r) in that region, the singular phase is theoretically possible but does not occur because 
the biomass does not reach the Xa level. Finally, we see that the bang-singular-bang phase is 
concentrated in a region where r is small and u large: the former allows for a reduced natural 
decrease of the biomass concentration, so that it does not need a lot of effort to be brought back 
up to at the beginning of the light phase; the latter allows for a very short phase of maximal 
harvesting so that it leaves plenty of time for a singular phase. Finally, we illustrated condition 



(17 1 by a dashed-dotted cyan line; this figure confirms what we had evidenced earlier: when u 
is above that line the optimal control does not suffer from control limitations that intrinsically 
prevent a singular phase (because u < Ug.) or forces the optimal control to be constant. 
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Productivity 




First switch) time 

Figure 4: Productivity level contours for bang-bang solutions with the first switching time in 
abscissa and the second switching time in ordinate. The optimal productivity level computed in 
the previous section is obtained at the black star. 



6.4 Importance of the open-reactor phase 

In the high-respiration case, we have identified a short window of opening of the bioreactor 
around the end of the day and the beginning of the night. In this subsection, we will show a 
simulation that evidences the fact that the main characteristics of this window is its length and 
not so much the exact time at which it takes place. We have considered the case where r = 0.7 
and computed the value of the productivity for switching times ti from m = to u between 0.44 
and 0.5 and t2 from u to between 0.5 and 0.56. The productivity is then illustrated by different 
color levels in Figure |4] the dark blue corresponding to zero (wash out of the reactor or almost 
closed reactor) and the purple to values above 0.6. A definite pattern appears on this figure: the 
productivity level is roughly constant along lines of the form t2 — 5 + ti. The productivity level 
then mainly depends on t2 — ti, that is the opening duration of the reactor or, equivalently, the 
total flow that goes through the reactor. 



6.5 Near-optimal strategies 

We have seen that the daily flow that goes through the chemostat has great importance for the 

productivity level of a solution. In order to conflrm that, we propose a strategy that is of the 

11 11 

bang-bang type and consists in having the dilution equal to u in the interval [T ^ ^1 

2u 2u 

and outside of this interval. That way, the total flow that goes through the reactor is equal 
to u, so that we will be able to compare the obtained productivity level between that strategy 
and constant control strategies that have the same daily total flow. We did the computations 
for u = 2 and values of u that did not lead to the wash-out of the reactor for both species of 
subsections 6.1 (on the left of Figure [5]) and |6.2| (on the right of Figure [5|. We see that, in 
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Figure 5: Productivity levels of species of subsections |6.1| (on the left) and 6.2 (on the right ): 
in red, the productivity attained with the constant control u = u and in blue the one with the 
near-optimal strategy of Section |6.5[ The dashed-lines represent the optimal productivity levels 
with u ~ 2 



both cases, the constant control (in red) yields a less productive process that the corresponding 
bang-bang strategy. This is especially true in the high-respiration case, but is also valid in the 
low respiration case, so that, when the exact optimal control law is not computed, it is advisable 
to choose a bang-bang one rather than a constant control. This strategy is stronly advisable 
since the optimal productivity level is represented through a dotted level in both figures and the 
near-optimal strategy achieves it almost in both cases for an appropriate daily flow. This was 
expected in the high respiration case where the optimal solution is bang-bang, because we had 
evidenced in Figure [4] that the actual timing of the beginning of the max-control window had 
little influence on the productivity level, but is also the case in the low-respiration case where the 
optimal solution is bang-singular-bang; even in this case, our proposed near-optimal strategy can 
almost achieve the optimal control level. This last property might however not hold for a high 
respiration species whose optimal pattern is bang-singular-bang: in that case, the corresponding 
best bang-bang near-optimal strategy might lead to large values of x{t) hence more respiration, 
at the time where the control should be singular. 



6.6 Beyond the photobioreactor 

Photobioreactors are not the only ecological systems that undergo natural periodic forcing. We 
will now derive an example that relies more on seasonality and that is built on the famous flshing- 
stock model and the Maximum-Sustainable- Yield (MSY, [23J). The question here is therefore 
to determine how flshermen can best exploit a fishing stock while allowing it to survive. When 
basing the study on the logistic growth model 

a; = ax ^1 — — ^ — qEx 

where x is the size of the stock, E is the fishing effort and q is the fish catchability, it is determined 
that the maximization of the number of caught fishes over the long-run is obtained by keeping the 
stock a,t X ~ ^ with E — These are our x^ and values. If we now consider that the fishing 
stock has a limited growing season (of length T) during which it satisfies the logistic growth) and 
a season (of length T — T) where only natural mortality and predation take place, we can set 



RR n° 7929 



20 



Grognard, Akhmetzhanov & Bernard 



5 




0.5 - ; 

fll 1 u \ 1 \ \ 1 \ \ 

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

time 

Figure 6: Comparison of the fishing stock when not fished (black curve), constantly fished (red 
curve) and using the bang-bang optimal control (blue curve). 

ourselves in the setting of the present paper. Indeed we can then define f{x) ~ rx = ax {l — -|^) 
with r the mortality rate during the non-growing season. We then define u — qE. Taking a = 6, 
A' = 10, r = 1, r = 0.2, T = 1 and u = 2, we first noticed on Figure |6] (black curve) that, in 
the absence of fishing, the fishing stock settles at a level that is way below K and even below ^, 
the value of the MSY, which shows that no singular phase is possible in the optimal solution. 
The bang-bang optimal solution is then computed (blue curve) with switching times at t — 0.188 
and 0.288 and compared with the best constant harvesting solution (red curve). In both cases, 
the fishing stocks are very similar during the growing season, but the optimal harvesting method 
reduces it at the beginning season so that mortality does not have time to do a lot of damage 
and, in the end, it improves the total of caught fishes during the season by 37%. 

7 Conclusions 

In this paper, we have shown how the day-night constraint influences the optimal control strategy 
that achieves maximal biomass daily productivity in a photobioreactor and reduces the optimal 
productivity level. We have identified three families of strategies that can achieve optimality: 
bang-singular-bang, bang-bang, and constant maximal control; the first two are characterized by 
an harvesting of the biomass at the end of the light phase and beginning of the night to limit 
the negative effects of the respiration, while the latter leads to permanent harvesting because 
the maximal dilution rate is too weak compared with the growth rate of the biomass. These 
families of control strategies have been built for a large set of nonlinear one-dimensional models 
with light-dark phases so that they can be applied beyond their motivation in this paper: that 
is a photobioreactor with Monod-like growth and Beer-Lambert light attenuation. Through 
simulations, we have shown that the necessity of applying an optimal control strategy strongly 
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depends on the respiration rate: if the latter is weak, constant control can achieve almost the same 
performance since the night phase consumes little biomass. However, we have also shown that a 
better choice is probably to apply a bang-bang control law which, in the presented simulations, 
always yields better productivity than comparable strategies with constant dilution. This is 
particularly supported by the fact the a bang-bang law with a proper timing can almost achieve 
the same productivity level as the optimal control law developed in the present paper; also this 
better productivity is achieved with a very similar cumulated effort as the one necessary for a 
constant dilution rate. 
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A Proof of Theorem [T] 

We will detail the different forms of solutions and show that no other solution than the one 
exposed in Theorem [T] can occur. 

Bang-bang with Aq > 1: With Aq > 1, we have u = at times and T. At least, a switch 
of u from to u and back to then needs to occur between time and T (otherwise the payoff 
would be 0, since the argument of the integral that defines the productivity would always be 0). 
As we have seen in Proposition [2]- (i), the switch from to m cannot take place in the dark phase. 
For the solution that we study, a switch then needs to take place at time too hi the (0, T) interval 
and for x(tou) = xqu < Xa and X(tQu) = 1 (Proposition [2]- (ii)). 

The switch from u — u to u — then needs to occur at some time tao > tou (and some value 
of x{tuQ) — xm)- Two possibilities then need to be considered: 
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• < T: from Proposition [2| we can deduce that Xuo > Xa- Applying u — Q then forces 
convergence toward x'^ for ^ t < T, so that x(t) increases, and so stays above x^ (so 
that x{T) = Xji > I'o- > xq). No switch back to m = u can then take place neither before 
T (because of (ii) of Proposition [2]) nor after T (because of (i) of Proposition [2]) . 

• tuo > T: from Proposition |2]-(i), we can deduce that no other switch takes place afterward. 
Two cases will then be considered: either xqu > so that x{t) decreases and 

Xuo or xqu < so that x^u < Xj^, and we do not necessarily know if > x^f) 

We have then shown that any bang-bang solution with u{Q) — Q presents a single switch to u ~ u 
(before T) and a single switch to m = (before or after T). We are then left with two things to 
show: first that t^o < T leads to a contradiction and then that, when xqu < x^ , we indeed have 

We will now show that the switch from u to needs to occur strictly after T. For that, we 
will consider that tuQ < T and show that this leads to a contradiction. Using the constancy of 
the Hamiltonian in [0,r), we have, by continuity of the variables at time T, that 

(/(a^o) - ^■a^o) = ^rifi^r) " "^^t) ' 
and, in (T,r], with x{T) = xq and A(r) — Xq: 

Xq {-rxo) = Xj^i-rxij^) . 
Taking the differences between the equalities, we obtain 

Ao/(a;o) = Xj^fix^) ■ 
Taking the quotient of the last two equalities then yields 

f{xo) ^ fjx^) 

X Q X 

with XTp > x„ > Xq. Remembering from Remark 1 that is a decreasing function, this leads 
to a contradiction because Xj^ > xq since the biomass only decreases at night. The switch from 
u — u to u — then needs to take place with i^o > T. 

We will now show that, even in the case where xqu < i", the second switch takes place with 
Xuo < xqu- For that, we first note that, since no switch from u — u to u — takes place in 
the [tou,T] interval, f{xj;) — rxj; > /(xqu) — txqu- Indeed, since x(t) is increasing along the 
considered solutions from xqu < Xa, f{x{t)) — rx{t) first increases from /(xoc) — rxosand then 
decreases (once x(t) gets above x^); if we had f{xTp) — rXj^ < /(xqu) — rxQ^, there would be a 
time t belonging to the interval (tofi,T] where f{x{t)) — rx{t) = f{xQu) — fa^oit- A switch then 
necessarily would have taken place at that instant because of constancy of the Hamiltonian 

UixQu) ~ rxQu) = Xit) {fix{i)) - (r + u)x{i)) + ux{t) 

results, using f{x{t)) ~ rx{t) = /(xoo) - rxoa, in 

(1 - X{i)) {}(x(i)) - rx{i)) = (1 - X{i))ux{i) . 

This can only be achieved if X{t) = 1, which corresponds to a switching instant (and a contra- 
diction) or (/(a;(f)) — rx(i)) = x{i), which would mean that x{i) — x^, which also is impossible 
since, in that phase, x{t) was converging in infinite time toward (and xqu < x^)- We then 
conclude that, as announced, f{xj;) — rxif > f{xQu) — txqu. 
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We then extensively use the constancy of the Hamiltonian in both the bright and the dark 
phase to show that x^q < Xoc. In the bright phase, we have 

{f{xo) - rxo) = (f{xQu) - rxQu) , 

and, in the dark phase 

Ao {-rxo) = {~rXuo) . 
Taking the difference between these equalities yields 

Ao/(a;o) = {f{xou) - rxou) + rx^o ■ 

Finally we note that, after tuo, the dynamics become 

A = rA, 

so that, using X{tuo) = 1 and A(T) = Aq, we have 

Ao = e'-(^-*-) , 

which yields 

/(a;o)e''^^"**"''' - rXuo = f{xou) - rxoa ■ 

Concavity implies that /(a;o)e'''^-^~*"") > /(a^oe'^'-"^"*""-') = f{xuo), so that the constancy of the 
Hamiltonian conditions can only be satisfied if 

fixua) - rXuQ < f{xou) - rxQu . 

This can only be achieved for Xuo < xqu, since Xuo < x^ and f{xj;) — rxj^ > f{xou) — rxou > 
f{xm) ~ ''"XuQ. 

Bang-singular-bang with Aq > 1: 

We will first look at what a singular arc could be. For that, we see that ^ = (1 — \)x 
should be over a time interval which, since a biomass level of a; = does not make sense when 
optimizing the productivity, amounts to imposing A = 1. We then compute its time derivatives. 

d 



dt 



When h{t) ~ 0, that is in the dark phase, no singular arc is thus possible. When h{t) ~ 1, this 
derivative is equal to zero when x = x„ defined in (10 1. The singular control is then the control 
that maintains this equilibrium, that is Ua defined in ( 11 ). This control is positive thanks to ( 13 1 
but it is smaller than u only if 

f[Ur\r)]<{r + u){fr\r). (18) 

No singular control can exist otherwise. In fact, this implies that x^ < x„ < xf . The case where 
u„ = u has been handled through the bang-bang case. 

When a singular branch appears in the optimal solution, it is locally optimal because the 
second order Kelley condition [24J: 

is satisfied on the singular arc because of the concavity. 
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The construction of the sokition is very similar to that in the purely bang-bang case. Similarly, 
a first switch needs to occur in the interval (0,T). This switch can be from u = to u = u or 
from u = to u ~ and should occur with x < x„ (Proposition [2]- (ii)). In fact, if a switch 
first occurs to u = u, x then converges toward a;", so that it does not go on or above Xa-, which 
prevents any other switch before T (Proposition|2j(iii)). No singular arc can then appear. These 
solutions have been handled earlier. 

In bang-singular-bang switch from to u^- then directly takes place once A = 1 at 

From there, A(t) = 1 and x{t) — x^ for some time. This could be until t^o < T, followed 
directly by m = or the singular arc could end at time t„u < T, where a switch occurs toward 
u = u; note that the strict inequality is due to the fact that, if we had tg-u — T, we would then 
have A(T) — 1 and A > for t > T, so that u directly goes to 0: no actual switch to u = u has 
taken place. Using the constancy of the Hamiltonian, we can conclude that a direct switch from 
Ucr to It = is not possible at t^o ^ T. Indeed, if such an early switch occurred, we would have 

^ ifi^o) - rxo) ^ Ay (/(xy) - rxj^) , 

and 

Ao i-rxo) = X^{-rxj^) . 
Taking the differences between the equalities, we obtain 

Taking the quotient of the last two equalities then yields 

7 

X Q X rj-i 

which we have shown earlier be impossible. The optimal solution then leaves the singular arc 
with u = u strictly before T, and switches to strictly after T. 

From then on, things are unchanged with respect to the bang-bang case. 

Solution with Aq < 1: 

Since A > in A = 1 in the dark phase, such a solution would mean that harvesting takes 
place during the whole dark phase because no transition from u = Q to u — u can take place in 
this phase (Proposition [2]-(i)). Two possibilities then occur: either u — u all the time or switches 
from u = u to u — Q or Ucr and then back to u = u take place in the interval (0, T). 

In the latter case, the first switch from u = u to u = Q can only take place with x > x„ 
(Proposition|2]-(iii)). Then, when the control w = is applied for some time, the solution x{t) is 
increasing. No switch back to u ^ u can then take place before T because such a switch would 
require x{t) < Xa (Proposition [2]- (ii)), which cannot occur. An optimal solution of this form 
cannot exist. 

We can also show that no strategy in the (0, T) interval can have the form u = m — > — > 
u = or u. Indeed, in order to reach the singular arc with u = u, a, solution should be coming 
from above it. If the switch that takes place at the end of the singular phase is from Ua- to 0, 
x{t) will increase and there should be a subsequent switch from to u which is impossible with 
x(t) > Xcr. If the switch that takes place at the end of the singular phase is from u„ to u, x{t) 
will decrease all the time between tg-fi and T, which is in contradiction with the fact that we had 
a;(0) > Xa- 

The only potential optimal control in that family is therefore u{t) — u for all times. Using 
the expressions computed previously, this control can be a candidate optimal control law only if 



xo = xomin wc havc seen earlier. This solution can only potentially exist if (14 1 is satisfied. 
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